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GENERATE A THREE DIMENSIONAL MODEL 
OF AN ENVIRONMENT FROM RANGE SENSOR 
INFORMATION REPRESENTING A HEIGHT 
FIELD FOR THE ENVIRONMENT 



TRACK POSITION AND ORIENTATION INFORMATION 
OF AT LEAST ONE IMAGE SENSOR IN THE 
ENVIRONMENT WITH RESPECT TO THE 
THREE DIMENSIONAL MODEL IN REAL-TIME 
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PROJECT REAL-TIME VIDEO IMAGERY INFORMATION 
FROM THE IMAGE SENSOR(S) ONTO THE THREE 
DIMENSIONAL MODEL BASED ON THE TRACKED 
POSITION AND ORIENTATION INFORMATION 



VISUALIZE THE THREE DIMENSIONAL MODEL 
WITH THE PROJECTED REAL-TIME VIDEO 
IMAGERY IN A VIRTUAL ENVIRONMENT 



FIG. 3 
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GENERATE A DEPTH MAP IMAGE 
FROM A VIDEO SENSOR VIEWPOINT 



PROJECTIVE TEXTURE MAP THE REAL-TIME VIDEO 
IMAGERY INFORMATION ONTO THE 3D 
MODEL CONDITIONED UPON VISIBILITY 
AS DETERMINED FROM THE DEPTH MAP IMAGE 
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PROJECT AND RESAMPLE POINTS IN RANGE 
SENSOR INFORMATION ONTO A REGULAR GRID 
ATA USER-DEFINED RESOLUTION 
TO PRODUCE A HEIGHT FIELD 
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PROCESS THE HEIGHT FIELD USING HOLE-FILLING 
AND TESSELLATION TO GENERATE A 
TRIANGLE MESH REPRESENTATION OF 
THE THREE DIMENSIONAL MODEL 
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IDENTIFY A STRUCTURE IN 
THE RANGE SENSOR INFORMATION 



530-^ 



SELECT A SET OF GEOMETRIC PRIMITIVES 
BASED ON A SHAPE OF THE STRUCTURE 
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FIT THE SET OF GEOMETRIC 
PRIMITIVES TO THE RANGE SENSOR 
INFORMATION WITH RESPECT TO 
THE IDENTIFIED STRUCTURE 



REFINE THE THREE DIMENSIONAL MODEL 
BASED ON OBJECT SURFACES MAPPED FROM 
IMAGES ACQUIRED BY TH IMAGE SENSORS 
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ESTIMATE BACKGROUND IMAGE BY 
MODELING THE BACKGROUND IMAGE 
AS A TEMPORAL PIXEL AVERAGE 
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SUBTRACT THE BACKGROUND IMAGE 
— * FROM THE REAL-TIME VIDEO 

IMAGERY INFORMATION 
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IDENTIFY FOREGROUND OBJECT(S) IN 
THE SUBTRACTED REAL-TIME VIDEO IMAGERY 
INFORMATION USING A HISTOGRAM-BASED 
THRESHOLD AND MORPHOLOGICAL NOISE FILTER 
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VALIDATE THE FOREGROUND OBJECT(S) 
BY CORRELATION MATCHING BETWEEN IDENTIFIED 
OBJECTS IN NEIGHBORING IMAGE FRAMES 
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OUTPUT THE VALIDATED FOREGROUND OBJECT(S) 



FIG. 15 



REPLACEMENT SHEET 
Attorney Docket No. 06666-0156001 
Page 8 of 8 



8/8 




